Out— of— equilibrium tricritical point in a system with long-range interactions 
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Systems with long-range interactions display a short-time relaxation towards Quasi Stationary 
States (QSSs) whose lifetime increases with system size. With reference to the Hamiltonian Mean 
Field (HMF) model, we here show that a maximum entropy principle, based on Lynden-Bell's 
pioneering idea of "violent relaxation" , predicts the presence of out-of-equilibrium phase transitions 
separating the relaxation towards homogeneous (zero magnetization) or inhomogeneous (non zero 
magnetization) QSSs. When varying the initial condition within a family of "water-bags" with 
different initial magnetization and energy, first and second order phase transition lines are found 
that merge at an out-of-equilibrium tricritical point. Metastability is theoretically predicted and 
numerically checked around the first-order phase transition line. 

PACS numbers: 05.20.-yClassical statistical mechanics 05.45.-aNonlincar dynamics and chaos 05.70.FhPhase 
transitions:general studies 



The emergence of phase transitions in thermal equi- 
librium is a well understood and widely studied phe- 
nomenon. For short-range interactions, phase transitions 
have been explained in the context of equilibrium statis- 
tical mechanics. Analytically, they are signalled by the 
appearance of singularities in the thermodynamic poten- 
tials at specific points (or regions) of the control param- 
eter space (temperature, energy, external magnetic field, 
etc.). The situation becomes more intricate when one 
considers systems with long-range interactions [l[ . In this 
case, the property of additivity, which is used when de- 
riving the canonical ensemble from the microcanonical, 
is no more valid. Due to this intrinsic difficulty, it has 
been only in the last decade that phase transitions have 
been analyzed with reference to models with long-range 
interactions, revealing a rich variety of interesting situa- 
tions 0. For instance, the inequivalence of microcanon- 
ical and canonical ensembles requires a separate analysis 
of the phase diagram in the two ensembles. Phase tran- 
sitions of first and second order are found, with related 
tricritical points, but their location in the controlparam- 
eters space is not the same in the two ensembles [3[ . This 
also justifies why one can find negative specific heat in 
the microcanonical ensemble 

Moreover, focusing on dynamical aspects, remarkable 
out-of-equilibrium features arc displayed for long-range 
systems. It is for instance well known that such sys- 
tems get trapped in long-lasting Quasi-Stationary-States 
(QSSs) i, before relaxing to thermal equilibrium. The 
existence of QSSs was recognized in a cosmological set- 
ting (see and references therein) and subsequently 
re-discovered in other contexts, e.g. plasma-wave in- 
teractions Q- Importantly, when performing the limit 
N oo (where N is the number of particles) before 



the infinite time limit, the system remains permanently 
confined in QSSs. Consequently, QSSs represent the 
solely experimentally accessible dynamical regimes for 
systems composed by a large number of particles subject 
to long-range couplings. This includes physical systems 
of paramount importance, ranging from Free Electron 
Lasers Q to ion and particle beams The emergence 
of QSSs has originated an intense debate on the founda- 
tion of statistical mechanics [H: surprisingly, the QSSs 
keep memory of the initial condition and, consequently, 
they cannot be interpreted by resorting to traditional 
Boltzmann-Gibbs treatments. In a recent series of pa- 
pers 0, [lol . 11 1 , an approximate analytical theory based 
on the Vlasov equation and inspired by the pioneering 
work of Lynden-Bell Q has been elaborated. This is a 
fully predictive approach that enables one to explain the 
appearence of OSS from first nrincinles. 
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FIG. 1: Theoretical phase diagram on the control parameter 
plane (Mo,f/): second order phase transition line (dashed); 
first order phase transition line (full); tricritical point (full 
dot). Inset: magnification of the first order phase transition 
region and limits of the metastability region (dash-dotted). 
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In this Letter we shall take one step forward and 
demonstrate, both analytically and numerically, that 
out-of-equilibrium phase transitions occur in the QSSs, 
separating qualitatively different dynamical regimes. 
The analysis is carried out for the Hamiltonian Mean 
Field (HMF) model [13] , which describes the motion of N 
coupled rotators. We determine the out-of-equilibrium 
phase diagram for a family of initial "water-bag" dis- 
tributions, displaying first and second order transition 
lines between homogeneous (zero magnetization) and in- 
homogeneous (non zero magnetization) QSSs, that merge 
together at a tricritical point. The metastability region 
near the first order phase transition line is also studied. 

The HMF model has the following Hamiltonian 
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where 9j represents the orientation of the j-th rotator 
and pj stands for the conjugated momentum. To mon- 
itor the evolution of the system, it is customary to in- 
troduce the magnetization, an order parameter defined 
as M = |M| = |^mi|/iV, where mi = (cos 6*;, sin 0^) 
is the magnetization vector. The HMF model shares 
many similarities with gravitational and charged sheet 
models d, 0] and has been extensively studied [l^l as 
a paradigmatic representative of the broad class of sys- 
tems with long-range interactions. Equilibrium statisti- 
cal mechanics calculations [l^l reveal the existence of a 
second-order phase transition at the critical energy den- 
sity Uc = 3/4: below this threshold value the Boltzmann- 
Gibbs equilibrium state is magnetized. 

As previously reported 0, |T3|, starting from some 
out-of-equilibrium initial conditions, for energies below 
Uc, the system gets trapped in QSSs, whose lifetime di- 
verges when increasing the number N of rotators. In this 
regime, the magnetization is lower than predicted by the 
Boltzmann-Gibbs equilibrium and the system displays 
non Gaussian velocity distributions 13, 3, 15| . 

In the limit of iV ^ oo, the system is described by the 
following Vlasov equation 

§(- + - ( [/] sin e - My [/] cos 0) 1^ = 0, (2) 

where f{9,p,t) is the one-body microscopic distribu- 
tion function, Mx[f] = J f cos 9 dO dp and My[f] = 
J f sui9d9dp. Hereafter, invoking rotational symmetry, 
we shall assume My = and denote M^ as M. With 
reference to cosmological applications, Lynden-Bell Q 
proposed an analytical approach to describe the station- 
ary solutions of the Vlasov equation. He considered 
the coarse-grained distribution function / over a finite 
grid and associated an entropy s[f] to such distribu- 
tion. The statistical equilibrium obtained by maximizing 
such entropy, while imposing the conservation of Vlasov 



dynamical invariants, would determine the initial "vio- 
lent" relaxation. This idea was later applied to the two- 
dimensional Euler equation [l6j . 

Consider now a family of water-bag initial distribu- 
tions, which take a constant value fo inside the phase- 
space domain D specified by 

D = {{9,p) e [-TT, tt] X [-CX), oo] I \9\ < A9, \p\ < Ap}, 

(3) 

where < A9 < tt and Ap > 0. The normalization 
condition fixes fo = l/(4A0Ap). Hence, the initial mag- 
netization Mo and the energy density U can be expressed 
as functions of A9 and Ap 
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which in turn implies that the initial water-bag profiles 
are uniquely determined by Mq and U , which take values 
in the ranges < Mq < 1 and > (1 - A/^)/2. With 
reference to this specific case, the Lynden-Bell entropy 
constructed from the coarse-grained function / reads 
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Requiring that this entropy is stationary, we obtain the 
following distribution (loj 
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where f3, A and a are Lagrange multipliers associated 
with the conservation of energy, momentum and mass. 
The magnetization in the QSS, Mqss = -^/[/qss], and 
the values of the multipliers are obtained by solving the 
self-consistent equations which follow by imposing the 
conservation laws mentioned above. Since we look for so- 
lutions where the total momentum is zero, the Lagrange 
multiplier A vanishes. It should also be emphasized that 
multiple local maxima of the entropy are in principle 
present when solving the variational problem. 

Let us introduce the control parameter plane (Mq, U) 
(these are indeed the analogues of thermodynamic fields 
in equilibrium). In Fig. [T] we plot the transition line 
that divides the region of the plane where the global 
maximum of Lynden-Bell entropy has Mqss = (ho- 
mogeneous state), where /qss(^iP) does not depend on 
9, from that where the maximum is for A/qss > (in- 
homogeneous state). This means that, e.g., when fixing 
the initial magnetization Mq and decreasing the energy 
density U, the system undergoes an out-of-equilibrium 
phase transition from a homogeneous to an inhomoge- 
neous state. Along the transition line two distinct re- 
gions can be isolated: the dashed line corresponds to a 
second order phase transition, the full line refers to a first 
order phase transition. First and second transition lines 
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merge together at a tricritical point, approximately lo- 
cated at {Mq,U) = (0.17,0.61). Tricritical points are a 
well known feature for systems at equilibrium, and are 
here shown to occur also out-of-equilibrium. 

Two important remarks are mandatory at this point. 
First, contrary to the usual equilibrium treatment, we 
here describe the behavior of the system at short time, 
when it attains a QSS. For equilibrium phase transi- 
tions, one instead looks at the behavior of the system 
at long times, when the magnetization corresponds to a 
global maximum of the Boltzmann entropy (rather than 
Lynden-Bell's entropy). Second, while U is a. standard 
control parameter, used also for equilibrium phase tran- 
sitions, the initial magnetization Mq does not appear in 
the standard treatment of equilibrium phase transitions. 
Indeed, when using Boltzmann entropy, the HMF model 
undergoes a second order phase transition at Uc = 3/4, 
independently of Mq. Let us notice that this transition 
energy value appears in Fig. [1] for Mq = 1. The lower 
edge of the metastability region, plotted in the inset, con- 
verges to U = 7/12 for Mq — > 0, a value found in [l3| 
to correspond to the destabilization of the homogeneous 
(zero magnetization) state in the Vlasov equation. 

To assess the correctness of the above theoretical pic- 
ture, we have performed numerical simulations of the 
HMF model ([T]) for finite N. To extrapolate the relevant 
behavior occurring in the limit N oo, where the Vlasov 
description applies, we have varied N from N = lO'^ to 
N = 10^. We have chosen two values of Mq, one in the 
first order phase transition region (Mq = 0.05) and the 
other in the second order region (Mq = 0.3). For these 
two values, we plot in Figl2]AfQss versus U for increas- 
ing values of N. The magnetization in the QSS is de- 
termined by averaging over time (20 < t < 100). Points 
and error bars in Fig|2] represent averages and standard 
deviations over several different initial conditions. The 
result of the theoretical analysis (full curve) is in reason- 
able agreement with the simulations, and the agreement 
improves, as expected, when N is increased. It must be 
also stressed that the predictions of the theory have no 
adjustable fitting parameter. This confirms the adequacy 
of Lynden-Bell's theoretical framework. The discrepan- 
cies detected near transition energies are discussed in [11 1 
and shown to correspond to regions where Lynden-Bell's 
entropy is substantially flat, which implies the existence 
of an extended basin of states where the system can pos- 
sibly be trapped. 

To clarify the behavior of Mqss in the first order phase 
transition region, we consider the energy value U ~ 0.6 
and solve the self-consistent equations for different ini- 
tial magnetization values Mq. Results are displayed in 
Figini where Mqss is plotted as a function of Mq. An 
inspection of this figure suggests to identify three regions, 
delimited by different values of the control parameter Mq. 
For Mq < 0.083 (region I), only one solution of the self- 
consistent equations is found which corresponds to an 
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FIG. 2: Mqss as a function of U for (a) Mo = 0.05 (first 
order phase transition), (b) AIq — 0.30 (second order phase 
transition). The number of initial realizations is 10^ (TV = 
10^), 10" (iV = 10"), 10^ (iV = 10") and the averaging time 
20 < t < 100. 
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FIG. 3: Mqss as a function of Mo for (7 = 0.6. 



entropy maximum and is associated with a homogeneous 
QSS (Mqss = 0). For Mq > 0.089 (region III), two so- 
lutions arc instead detected: the one with Mqss > 
is stable, while that with Mqss = is unstable. Fi- 
nally, for 0.083 < Mo < 0.089 (region II), three solutions 
arc obtained: two of them (respectively with Mqgg = 
and A/qgg ^ 0) are local maxima of the entropy, thus 
thermodynamically stable. The third one (Mqss, with 

^^QSS < -^QSS ^ -^Qss) is ^ local minimum, hence un- 
stable. The expected equilibrium state is consequently 
determined by evaluating the coarse-grained entropy in 
correspondence of the former two stationary points and 
deducing the actual global maximum. Aiming at fully re- 
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solving the magnetization curve for U = 0.6, one has to 
perform this additional test for each selected value of Mq: 
a direct calculation enables to track the profile outlined 
in Fig. [3] with a tick solid line. 

Dynamically, it could however happen that the sys- 
tem is eventually prevented from approaching the most 
probable state as predicted by the theory, when initially 
prepared to fall in region II. While exploring the phase- 
space, and due to metastability, the system could in fact 
remain indefinitely trapped in the proximity of the local 
maximum. The edges of region II correspond to the lat- 
eral edges of the metastability region reported in the inset 
of Fig. [T] The existence of homogeneous and inhomoge- 
neous phases, corresponding to different local maxima 
of the entropy, can be checked by computing the proba- 
bility distribution function of M. In Fig|3]we report the 
histograms of the magnetization computed in the time in- 
terval 20 < i < 100 for U = 0.6 and distinct values of Mq. 
When Mq ~ 0.08 the system falls in region I of Fig. [H 
only one peak is here observed around M = 0, the mean 
value being slightly different from zero due to finite size 
effects (see Fig.UJa)). For Mq = 0.1, i.e. in region III, an 
isolated peak is manifested, associated with an inhomo- 
geneous state (see Fig. IDJd)). For Mq = 0.0848 (region 
II) two peaks are identified at M ~ and M ^ 0.1 for 
N = 10^ (the peaks are shifted to the right for TV = 10^ 
due again to finite size effects), implying the existence 
of two local maxima of the entropy (see Fig. HKb)). The 
situation in Fig. |4ljc) is intermediate between the single- 
peaked and the double-peaked distribution although the 
Mq value lies inside region III, possibly due to finite size 
effects. One should add that, close to the transition, 
the positions of the magnetized peaks are only in rough 
agreement with the theory. 
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FIG. 4: Probability distribution functions of M. Dashed 
(resp. solid) lines stand for N = 10^ (resp. A'' = 10^), av- 
eraged over 10^ (resp. lO'^) independent realizations. M is 
always sampled in the time range 20 < i < 100. 



In this Letter, we have investigated the emergence of 



out-of-equilibrium Quasi Stationary States (QSSs) in the 
Hamiltonian Mean Field (HMF) model, a paradigmatic 
representative of systems with long-range interactions. 
We have proved the existence of out-of-equilibrium first 
and second order phase transitions. The transition lines 
merge at a tricritical point. Coexistence of homogeneous 
(zero magnetization) and inhomogeneous (non zero mag- 
netization) phases is present at the first order phase tran- 
sition line and a metastability region is revealed. Such 
transitions are expected generically in models with long- 
range interactions, see e.g. Ref. [T^]. Our conclusions 
are analytically derived using an approach pioneered by 
Lynden-Bell [J] . The agreement with the simulations rep- 
resents an a posteriori validation of Lynden-Bell's sce- 
nario. Besides their intrinsic theoretical relevance, we 
expect our results to translate into novel experimental 
solutions, with reference to those applications where long 
range forces are active and QSSs have been observed (e.g. 
plasmas. Coulomb systems). 
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